Skip to content

Conversation

@crypdick
Copy link
Contributor

Adds a new tutorial serving Pytorch models on Ray Serve.

This should be merged after #3694 since otherwise the new Ray version will break the existing Tune tutorial.

I will remove the [WIP] label after the Ray Serve team finishes their review.

@pytorch-bot
Copy link

pytorch-bot bot commented Dec 18, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/tutorials/3709

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the cla signed label Dec 18, 2025
*.egg-info/
.installed.cfg
*.egg
.git
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Needed due to a bug in Ray; working on a PR

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@crypdick crypdick changed the title [WIP] Ray serve tutorial [WIP] New Ray Serve tutorial Dec 18, 2025
edoakes added a commit to ray-project/ray that referenced this pull request Jan 8, 2026
## Description
Automatically exclude common directories (.git, .venv, venv,
__pycache__) when uploading working_dir in runtime environment packages.

At a minimum we need to exclude `.git/` because unlike the others,
nobody includes .git/ in `.gitignore`. This causes Ray to throw a
`ray.exceptions.RuntimeEnvSetupError` if your `.git` dir is larger than
512 MiB.

I also updated the documentation in handling-dependencies.rst and
improved the error message if the env exceeds the GCS_STORAGE_MAX_SIZE
limit.

## Related issues
N/A

## Additional information
This PR pytorch/tutorials#3709 was failing to
run because the PyTorch tutorials .git/ folder is huge.

---------

Signed-off-by: Ricardo Decal <[email protected]>
Signed-off-by: Ricardo Decal <[email protected]>
Signed-off-by: Ricardo Decal <[email protected]>
Co-authored-by: Ricardo Decal <[email protected]>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Edward Oakes <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants